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(54) Video transmission method and remote monitoring system using it 



(57) Video images are coded using an MPEG sys- 
tem, and the codes are packetized by a packetizer as 
differentiated by the picture type. Packetized I pictures 
and P pictures are sent out in synchronism with video 
frames. Each B picture is sent out following the sending 
of an I picture or a P picture. Depending on the extent of 
congestion of a communication line on which the pic- 



tures are sent out, packets of B pictures which cannot 
be transmitted are discarded. Layered coding is also 
used for the coding of video images, and layers lower in 
priority of B pictures which cannot be transmitted are 
discarded. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 5 

[0001] The present invention relates to a moving 
picture transmitting system and a moving picture trans- 
mitting/receiving apparatus, and more particularly to a 
moving picture transmitting system and a moving pic- 10 
ture transmitting/receiving apparatus for coding video 
signals using MPEG codes and transmitting the coded 
video signals. 

Description of Related Art 15 

[0002] The Japanese Published Unexamined Pat- 
ent Application No. Hei 1 0-262245 proposes a method 
of remedy to cope with impossibility to transmit within a 
one-video frame period (e.g. 29.97 Hz), where video 20 
signals coded frame by frame are to be transmitted in 
video transmission over a packet-based network. The 
cited patent uses layered coding for video coding. Lay- 
ered coding is a method by which a picture is divided 
into a higher layer of greater importance, which at least 25 
is required, and a lower layer of lesser importance, and 
coded in that layered state. According to the above-cited 
publication, when a one-frame equivalent of a coded 
picture cannot be transmitted within a one-video frame 
period, the quantity of transmission is controlled by dis- 30 
carding the layer of lesser importance out of the layer- 
coded picture . This method ensures regeneration of a 
picture synchronized with the video frame period. 
[0003] Layered coding methods include ones of 
temporal scalability according to the MPEG2 specifica- 35 
tion (ITU-T H.262, ISO 13818-2), spatial scalability, 
SNR scalability, and data partitioning. The Japanese 
Published Unexamined Patent Application No. Hei 8- 
46960 describes a method of layered coding sub-band 
by sub-band, and the Japanese Published Unexamined 40 
Patent Application No. Hei 4-100494 describes a lay- 
ered coding method by which the amount of video qual- 
ity deterioration is calculated by utilizing DCT (discrete 
cosine transform) and bring the amount of video quality 
deterioration closer to its permissible limit. 45 
[0004] Further, a remote monitoring system accord- 
ing to the prior art subjected a picture to compression 
coding on the camera side and coded signals were 
transmitted to the monitoring apparatus. Another 
method consisted of recording pictures with a VTR on 50 
the camera side and reproducing the VTR-recorded pic- 
tures offline. 

SUMMARY OF THE INVENTION 

55 

[0005] The above-described method according to 
the prior art involved the problem that, because trans- 
mission is accomplished in units of a one- video frame 



period each, the layer of lesser importance out of layer 
coded pictures is discarded unless transmission is com- 
pleted within a one-video frame period. Or where coding 
utilizing an MPEG (Moving Picture Experts Group) 
standard is used, there is the problem of an increased 
probability of layer discarding on account of failure to 
complete transmission of a one-frame equivalent of 
codes within a one-video frame period. 
[0006] The MPEG method codes video frames in 
three types of pictures: I (Intra-coded) pictures, P (Pre- 
dictive-coded) pictures and B (Bidirectionally predictive- 
coded) pictures. As a P picture results from the coding 
of differences of past I pictures or P pictures, and a B 
picture derives from the coding of differences of preced- 
ing and following I pictures and P pictures, the quantita- 
tive relationship among I, P and B pictures is I picture > 
P picture > B picture . In particular, the code amount of 
an I picture is often five times as great as that of a B pic- 
ture or even greater. If I, P and B pictures are transmit- 
ted at a bitrate representing the average of their 
respective totals, the transmission of an I picture is more 
likely to fail to be accomplished within a one-video frame 
period. By the conventional method, *rf a picture cannot 
be transmitted within a one-video frame period, the 
layer which fails to be transmitted is discarded. An I pic- 
ture, in particular, is referenced from a P picture or a B 
picture. Accordingly, there is the problem that partial 
discarding of an I picture increases the video quality 
deterioration due to decoding on the receiving side. 
[0007] According to the other of the above- 
described prior art method, a remote monitoring system 
codes pictures picked up by a camera, and transmits 
the coded pictures to a monitoring apparatus via a com- 
munication line. A fee is charged for the use of a com- 
munication line. The fee has so far been charged 
according to the duration of communication, but charg- 
ing proportional to the information quantity (on a bit 
basis) is expected to become the mainstream in the 
future. Therefore, it is conceivable to save the line fee by 
increasing the compression ratio to reduce the amount 
of codes. Coding of pictures, as it usually applies a com- 
pression technique based on visual characteristics 
including the removal of high frequency components, 
involves the problem that raising the compression ratio 
would entail a greater loss of video information including 
high frequency components and a resultant deteriora- 
tion in picture quality. 

[0008] Any method for reducing picture quality dete- 
rioration should take into consideration a coding system 
which permits control of the amount of codes so that 
important picture elements be coded in a low compres- 
sion ratio and others in a high compression ratio. 
[0009] Coding methods for controlling the amount 
of codes (varying the compression ratio) include varia- 
ble bitrate coding and trans-coding. Variable bitrate cod- 
ing is a method for controlling the amount of codes to be 
outputted according the amount of codes demanded at 
the time of coding. Trans-coding is a method to re-code 
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already coded data by a system different from the initial 
system of coding. 

[001 OJ In variable bitrate coding or trans-coding, the 
amount of codes is controlled by varying coding param- 
eters as demanded by the monitoring apparatus. How- 5 
ever, the output of coding by any such method is fixed at 
the amount of codes to which it is controlled. Accord- 
ingly, there is a problem that, if pictures coded in the 
best quality are desired to be recorded on the part of the 
camera apparatus, a second encoder intended for stor- w 
age will be required. 

t0011] A first object of the present invention is to 
reduce the deterioration of picture quality which is 
invited, when coded pictures are transmitted, by an 
increase in jitters or the like ensuing from delays at the w 
time of transmission or abrupt variations in the quantity 
of coding. 

[001 2] A second object of the invention is to reduce 
the probability for coded pictures, when coded pictures 
are transmitted, to be discarded. 2 o 
[001 3] A third object of the invention is to transmit a 
reduced data quantity of pictures coded by a single 
encoder and, at the same time, to realize storage of pic- 
tures of high quality without reducing the data quantity 
of coded pictures. It is also to transmit a reduced data 25 
quantity of coded pictures stored without using trans- 
coding. 

[001 4] A fourth object of the invention is to transmit 
to a monitoring apparatus a reduced data quantity of 
coded pictures stored in a camera apparatus and to 30 
regenerate them in high picture quality on the part of the 
monitoring apparatus. 

[001 5J in order to achieve the first object stated 
above, a transmission method utilizing the characteris- 
tics of picture coding by an MPEG system is used. A B 35 
picture, since it is coded by referencing } or P pictures 
both before and after it, is coded after the I or P pictures 
are coded. Therefore, a coded B picture is outputted 
after the outputting of the encoded following picture 
which was referenced. Where video frames 1 , 2, 3, 4, 5, 40 
6 and 7 successively inputted along the time axis are to 
be coded in a sequence of, for instance, I, B, B, P, B, B 
and I, the coded outputs of coding by the MPEG system 
come out in the sequence of 1, 4, 2, 3, 7, 5 and 6 in 
video frame number. As a B picture is coded after the 45 
coding of the following reference frame, it is always 
coded behind by an equivalent of two video frames. 
Therefore, there will be no problem if it is transmitted by 
the time of the decoding of the following reference 
frame. In this example, if I and P pictures are transmit- so 
ted in synchronism with a three-video frame period, and 
the transmission of the B picture is completed within 
three periods, decoding on the receiving side can be 
normally accomplished. 

[0016] in order to achieve the second object stated 55 
above, pictures are coded by utilizing layered coding. By 
layered coding, one video frame is divided into a plural- 
ity of layers. When a B picture cannot be transmitted in 



time, by discarding a layer of lesser priority in the layer 
coded B picture t a video frame can be generated from a 
layer of higher priority. 

[0017] In order to achieve the third object stated 
above, pictures are coded utilizing layered coding. 
[0018] A camera apparatus is enabled to adjust the 
quantity of data transmitted by subjecting pictures to 
layered coding, combining coded layers in a descending 
order of relative importance so as to provide codes in 
the amount demanded by the monitoring apparatus, 
and transmitting the combined layers. 
[0019] By causing every layer of layered codes to 
be stored on the part of the camera apparatus simulta- 
neously with transmission, the stored layers of pictures 
can be selectively transmitted on a later day upon 
request from the monitoring apparatus. 
[0020] In order to achieve the fourth object stated 
above, layers received by the monitoring apparatus are 
stored. When a picture stored at the camera apparatus 
at the same time as the picture stored there is to be 
demanded, the quantity of communication can be 
reduced by demanding from the camera apparatus the 
difference between the layers stored at the monitoring 
apparatus and all the layers stored at the camera appa- 
ratus. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0021] These and other objects, features and 
advantages of the present invention will become more 
apparent from the following detailed description of the 
preferred embodiments when taken in conjunction with 
the accompanying drawings, wherein: 

Fig. 1 is a block diagram illustrating a first embodi- 
ment of the present invention. 
Fig. 2 is a flowchart illustrating the operation of the 
first embodiment of the invention. 
Rg. 3 is a time chart illustrating the operation of Fig. 
1. 

Fig. 4 is another time chart illustrating the operation 
of Fig. 1 . 

Fig. 5 is a block diagram illustrating a second 

embodiment of the invention. 

Rg. 6 is a flowchart illustrating the operation of the 

camera apparatus of the second embodiment of the 

invention. 

Rg. 7 is a flowchart illustrating the operation of the 
monitoring apparatus of the second embodiment of 
the invention. 

Rg. 8 is a time chart illustrating layers to be trans- 
mitted in the second embodiment of the invention. 
Fig. 9 is a time chart illustrating layers to be stored 
in the first storage of the second embodiment of the 
invention. 

Fig. 1 0 is a time chart illustrating layers to be stored 
in the second storage of the second embodiment of 
the invention. 
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DESCRIPTION OF PREFERRED EMBODIMENTS 

[0022] A first embodiment of the present invention 
will be described below with reference to Fig. 1. 
[0023] The first embodiment of the invention per- 
forms coding by an MPEG system, individual frames 
being supposed to be reiteratively coded in the order of 
IBBPBB in picture type. This embodiment, of course, in 
no way restricts the order of picture types. 
[0024] in Fig. 1,10 denotes a transmission system; 
11, video signals; 12, an MPEG encoder; 13, a pack- 
etizer; 14, a transmit buffer; 15, a transmitter; 16, a pic- 
ture type detector; 17, a counter; 18, a synchronizing 
signal; 20, a receiving system; 21, a receiver; 22, a 
receive buffer; 23, an error corrector; 24, an MPEG 
decoder; 25, regenerated video signals; and 30, a com- 
munication line. 

[0025] Next will be described the operation of each 
part of Fig. 1 with reference to the flowchart of Fig. 2. 
[0026] The MPEG encoder 12, to which video sig- 
nals 11 are inputted (100), outputs a stream coded by 
the MPEG system (101). The packetizer 13 divides by 
the picture type the stream outputted from the MPEG 
encoder 12 to accomplish packetization. The transmit 
buffer 1 4 temporarily stores the transmit packet, pack- 
etized by the packetizer 1 3, to adjust the timing of trans- 
mission. The picture type detector 1 6 detects the picture 
type of the transmit packet (102). The counter 17 out- 
puts a synchronizing signal in every third period of a 
clock synchronized with video frames. The transmitter 
15, if it is judged by the picture type detector 16 that the 
transmit packet to be transmitted is an I picture or a P 
picture, immediately transmits it (105) via the communi- 
cation line 30 to the receiving system 20 in synchronism 
with a synchronizing signal 18 (106) outputted by the 
counter 1 7. If it is judged by the picture type detector 1 6 
that the transmit packet to be transmitted is a B picture, 
it will be transmitted following the transmission of an I 
picture or a P picture (105) . Then it is checked whether 
the transmission time of the B picture will pass the tim- 
ing of the next synchronizing signal 18 to be outputted 
by the counter 1 7 (1 03) and, if it will, its transmission is 
given up and the B picture is discarded (104). 
[0027] The receiver 21 receives the packet trans- 
mitted by the transmitter 15. The receive buffer 22 
stores the packet received by the receiver 21 . The error 
corrector 23 checks the packet received by the receiver 
21; if a B picture has been discarded, it inserts a copied 
B picture so that a similar picture to the video frame pre- 
ceding the discarded B picture be regenerated; and out- 
puts an MPEG coded stream. The MPEG decoder 24 
decodes the MPEG coded stream restored by the error 
corrector 23, and outputs a regenerated video signal 25. 
[0028] To add, this embodiment, in which an exam- 
ple of restoring method by the error corrector 23 is 
shown, in no way restricts the method for restoration. 
[0029] Next will be described the operation of Fig. 1 
with reference to Fig. 3. Fig. 3 is a time chart illustrating 



the operation of a transmission system using the config- 
uration of Fig. 1. This embodiment represents a case in 
which two B pictures are present between an I picture 
and a P picture , Of course, this in no way restricts the 

5 sequence of different picture types. 

[0030] Video signals 1 1 are inputted at video frame 
intervals. The MPEG encoder 12, in coding the video 
signals 1 1 by the MPEG system, codes the first video 
frame as an I picture . Then, before coding the second 

10 and third video frames, it codes the fourth video frame 
as a P picture. Next, after the coding of the I picture and 
the P picture, it codes the second and third video frames 
as B pictures. This MPEG coding results in the coding of 
B pictures delayed by an equivalent of three video 

15 frames. 

[0031 ] Each coded picture is transmitted as a trans- 
mit packet. I pictures and P pictures are transmitted in 
synchronism with a synchronizing signal 18. B pictures 
are transmitted following the transmission of an I picture 

20 or a P picture. On this occasion, the I picture or the P 
picture may contain large amounts of codes, and the 
duration of its transmission may span a plurality of video 
frame intervals. If the I picture or the P picture takes so 
long a time to transmit that the duration of B picture 

25 transmission passes the timing of the next synchroniz- 
ing signal 1 8, that B picture is discarded but is not trans- 
mitted. 

[0032] The receiving system 20 decodes each of 
the received pictures. On this occasion, the lacking B 

30 picture is regenerated free from errors by either copying 
the B picture immediately before the discarded B picture 
or generating and inserting a B picture with differences 
of 0 from the reference pictures before and after. 
[0033] Fig. 4 is a time chart illustrating the operation 

35 of a transmission system using the configuration of Fig. 
1 with layered coding added to the MPEG encoder 12. 
Layered coding in this embodiment divides each of the 
MPEG coded I, P and B pictures into three layers. Of 
these layers, the layer with the highest priority is 

40 denoted by H; that with a medium priority, by M; and that 
with the lowest priority, by L. 

[0034] If the transmission of the B picture in a trans- 
mit packet is not completed by the next synchronizing 
signal 18, layers of that B picture are discarded and 

45 refrained from transmission in the ascending order of 
priority. Although this embodiment represents a case in 
which B1L and B2L are discarded, this in no way 
restricts the order of discarding: a layer or layers lower 
in priority of either an I picture or a P picture may as well 

so be discarded, 

[0035] A second embodiment of the present inven- 
tion will be described below with reference to Fig. 5. 
[0036] In Fig. 5, 50 denotes a camera apparatus; 
51, a video camera; 52, a layered encoder; 53, a selec- 

55 tor; 54, a transmitter; 55, a first storage; 56, a controller; 
68, communication line; 60, a monitoring apparatus; 61, 
an input device; 63, a receiver; 65, a second storage; 
66, a layered decoder; and 67, a monitor. 
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[0037] Next will be described the operation of each 
part of Fig. 5 with reference to the flowcharts of Figs. 6 
and 7. 

[0038] First will be described the operation of each 
part when a demand for a real-time video image picked 
up by the video camera 51 is made from the monitoring 
apparatus 60 to the camera apparatus 50 (120) (131). 
The layered encoder 52 inputs the image picked up by 
the video camera 51 (121) and subjects it to layered 
coding (122) . The selector 53 selects a layer in accord- 
ance with the demand Inputted to the input device 61 of 
the monitoring apparatus 60 (123). The transmitter 54 
transmits the layer, selected by the selector 53, via a 
communication line 68 to the monitoring apparatus 60 

(1 25) . The first storage stores other layers than the layer 
selected by the selector 53 (1 24). ^ 
[0039] In the monitoring apparatus 60, the receiver 
63 receives the layer transmitted by the transmitter 54 
(130). The second storage stores the received layers 
(1 32). The layered decoder subjects the received layers 
to layered decoding (133) and regenerates them on the 
monitor 67. 

[0040] Next will be described the operation of each 
part when the monitoring apparatus 60 demands any of 
the stored video images from the camera apparatus 50. 
[0041] The first storage 55 outputs the layers to be 
transmitted in accordance with the demand inputted to 
the input device 61 of the monitoring apparatus 60 

(126) . The transmitter transmits the layers outputted by 
the first storage 55 via the communication line 68 to the 
monitoring apparatus 60 (125). 

[0042] In the monitoring apparatus 60, the receiver 
63 receives the layers transmitted by the transmitter 54 
(130). The second storage outputs stored layers of the 
same video frame as the video frame of the layers 
received by the receiver 63 (134). The layered decoder 
combines the received layers and the layers outputted 
by the second storage 65 to perform layered decoding 
(1 35) and regenerates the result on the monitor 67. 
[0043] It is of course possible to use the transmis- 
sion method described in connection with the first 
embodiment as the transmission method for this 
embodiment. 

[0044] Fig, 8 , Fig. 9 and Fig. 10 are time charts 
illustrating the operation of the second embodiment of 
the present invention. In this embodiment, three kinds of 
layers (H, M and L) differentiated according to the rela- 
tive importance are outputted by the layered encoder 
52. To add, there is nothing to restrict the number of lay- 
ers in this embodiment. 

[0045] Fig. 8 illustrates the layers transmitted by the 
camera apparatus 50; Fig. 9, those stored in the first 
storage; and Fig. 1 0, those stored in the second stor- 
age. 

[0046] In Fig. 8, the camera apparatus 50, upon 
demand from the monitoring apparatus 60, transmits 
the layer H from time to till time t1 ; the layers H and M 
from time tl till t2; the layers H f M and L from time t2 till 



t3; and the layer H from time t3 till t4. 
[0047] In Fig. 9, the first storage stores the layers M 
and L from time to till time t1 ; the layer L from time t1 till 
time t2; and the layers M and L from time t3 till time t4. 

5 [0048] In Rg. 10, the second storage stores the 
layer H from time to till time t1 ; the layers H and M from 
time t1 till time t2; the layers H, M and L from time t2 till 
time t3; and the layer H from time t3 till time t4. 
[0049] The monitoring apparatus can regenerate 

w images of higher quality by receiving the remaining lay- 
ers stored In the second storage shown in Fig. 10 and 
the layers stored in the first storage shown in Fig. 9. 
[0050] According to the present invention, as the 
timing of transmission is synchronized with the coding 

15 of an I or a P picture, there is the effect of a reduction in 
transmit buffer on the transmitting side. 
[0051] On the receiving side, decoding is usually 
stabilized by increasing the receive buffer when trans- 
mission is accomplished asynchronously on the send- 

20 ing side. Where the transmitting time is to be 
synchronized with the coding time, as coded data are 
received in synchronism with the coding time without 
fail, there is the effect of making possible a reduction in 
receive buffer. 

25 [0052] In MPEG coding, the amounts of codes of 
individual frames are not uniform, and especially, the 
code amount of an I picture is often five times as great 
as that of a B picture or even greater. Furthermore, I pic- 
tures are important video frames, which are referenced 

30 by P pictures or B pictures. Therefore, the time available 
for transmission should be long enough to allow each I 
picture to be transmitted completely, and there is the 
effect that the transmission of each I picture can be 
accomplished without fail by timing the transmission of 

35 the B picture after the transmission of the I picture. 
Moreover, there is the further effect that, when a B pic- 
ture cannot be transmitted by the transmission time of 
the next P picture or I picture, it need not be transmitted 
but decoding can still be continued even though the 

40 video frame of the B picture would be missing. 

[0053] Furthermore the use of layered coding pro- 
vides the effect that, when there is no sufficient time for 
the transmission of a B picture, the image can be regen- 
erated on the decoding side with a reduced deteriora- 

45 tion of picture quality by partially discarding a layer of 
low priority. 

[0054] Further according to the invention, as the 
quantity of video information to be transmitted can be 
controlled at the discretion of the receiving party, there 

so is the effect of saving the fee for communication line 
use. There is the further effect that, for instance, where 
an ISDN line is used, coded video images are transmit- 
ted by using one 64 Kbps line at normal times, while two 
lines are used in an emergency to transmit images of 

55 high quality. 

[0055] There also is the effect of enabling real-time 
transmission of video images to the monitoring appara- 
tus with the amount of coding kept under control and the 
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recording of all video images on the part of the camera 
apparatus to be accomplished at the same time without 
using a plurality of encoder. 

[0056] There is the further effect of enabling real- 
time transmission of video images to the monitoring 5 
apparatus with the amount of coding kept under control 
and the transmission of video images to the monitoring 
apparatus with the amount of coding of stored video 
images kept under control to be accomplished at the 
same time without using a plurality of encoder. w 
[0057] Further by causing the camera apparatus to 
transmit other layers than those that have been once 
received, there is the effect of saving the cost of com- 
munication. 

[0058] While the present invention has been 15 
described above with reference to the preferred embod- 
iments, any person of ordinary skill in the art would be 
enabled by this disclosure to make various modifica- 
tions of these embodiments and still be within the scope 
and spirit of the invention as defined in the appended 20 
claims. 

Claims 

1 . A moving picture transmission method wherein, out 25 
of an I (Intra-coded) picture and a P (Predictive- 
coded) picture in an MPEG (Moving Picture 
Experts Group) system, the I picture is transmitted 
first in synchronism with the video frame period of 
the P picture, and a B (Bidirectionaliy predictive- 30 
coded) picture is transmitted if it can be transmitted 
within the video frame period of the I picture and the 
P picture. 



a storage for storing said plurality of layers, and 
a means for selecting at a demand from a mon- 
itoring apparatus either video images sub- 
jected to layered coding by said encoder or 
layers of video images, having undergone lay- 
ered coding, stored in said storage, and trans- 
mitting them to said monitoring apparatus. 

5. A camera apparatus, as stated in Claim 4, wherein 
the means for transmission to said monitoring 
apparatus selects differential layers between the 
layers stored in said monitoring apparatus and lay- 
ers stored in said storage, and transmit them to said 
monitoring apparatus. 

6, A monitoring apparatus, connected to a camera 
apparatus having a encoder for subjecting video 
images inputted from a video camera to layered 
coding into a plurality of layers, a first storage for 
storing said plurality of layers, and a means for 
transmitting video images coded by said encoder, 
for decoding and regenerating coded images trans- 
mitted from said camera apparatus, wherein: 

it is provided with a second storage for storing 
layers received from said camera apparatus, 
and 

it demands from said camera apparatus to 
transmit differential layers between the layers 
stored in said second storage and layers stored 
in said first storage, and transmit them to said 
monitoring apparatus. 



2. A moving picture transmission method, as stated in 35 
Claim 1, wherein said I picture, said P picture and 
said B picture are subjected to layered coding, and 
the pictures having undergone layered coding are 
transmitted in an order giving priority to layers 
greater in importance. ^ 

3. A moving picture transmission method wherein: 

video images are coded using an MPEG sys- 
tem, 45 
said coded video images are packetized as dif- 
ferentiated by the picture type, 
said packetized I pictures and P pictures are 
sent out in synchronism with video frames, and 
each B picture is transmitted if it can be trans- so 
mitted within said video frame, or discarded if it 
cannot be transmitted within said video frame. 



4. A camera apparatus comprising: 

55 

a encoder for subjecting video images inputted 
from a video camera to layered coding into a 
plurality of layers, 
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